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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates in general to multi-input display devices and more 
particularly to an apparatus and method for providing control of a picture within a picture 
(PWP) display device having inputs from two different computers displayed in two 
separate windows such that an input device from one of the computers can be used to 
control both windows. 

2. Related Art 

Picture within a picture (PWP) display devices are popular devices that allow 
connection of at least two computers. PWP display devices are popular among higher- 
end computer systems for connecting to multiple command workstations. The PWP 
display device typically has two input ports with each port connected to a separate ^ 
computer. The PWP display device is similar to a typical computer display device 
except that the PWP display device can display data from two computers 
simultaneously. The PWP display device displays data from a first computer in a first 
window (typically the main or background window) and data from a second computer in 
a second window (typically a smaller window). A cursor on the PWP display device is 
controlled by the first computer when the cursor is in the first window. This allows the 
user to control and manipulate the data displayed in the first window with a first input 
device (such as a mouse) connected to the first computer. When the cursor is moved to 
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the border of the second window the first input device can no longer control the cursor 
and the cursor stops. The user must then move over to the second computer and use a 
second input device (such as a mouse) connected to the second computer to control the 
cursor. Thus, the mouse connected to the first computer is used to control the cursor 
5 when it is in the first window while the mouse connected to the second computer is used 
to control the cursor when it is in the second window. 

There are several problems with this arrangement. First, whenever the cursor 
reaches the border of the second window it will no longer accept inputs from the mouse 
of the first computer. This means that the user must move to the second computer and 
1 0 use the mouse connected to the second computer to control the cursor. This takes time, 
is inconvenient and can cause user frustration. More importantly, it is not possible to cut 
or paste in or out of the second window. This is because all cut and paste data is stored 
in the mouse driver buffer area of each respective computer. 



1 5 display device that eliminates the need for a user to manually move between the input 
devices of separate computers. In particular, what is needed is a PWP display device 
control apparatus and method that allow a single keyboard/mouse pair to be used to 
control both windows on the PWP display device. Moreover, what is needed is an 
apparatus and method that permits cutting and pasting between windows of the PWP 

20 display device. 



To overcome the limitations in the prior art as described above and other 
limitations that will become apparent upon reading and understanding the present 

25 specification, the present invention includes an apparatus and method for controlling a 
picture within a picture (PWP) display device. The PWP display device, which is 
connected to least two computers, contains a main window (that displays data and 
images from a first computer) and a PWP window (that displays data and images from a 
second computer). The present invention allows a user to use input devices from one of 

30 the computers to control data and images in both windows. The present invention also 
allows data and images to be cut and pasted between the main window and the PWP 
window. 

The apparatus of the present invention includes a PWP control module that 
resides on each of the computers connected to the PWP display device. The PWP 



Accordingly, what is needed is an apparatus and method for controlling a PWP 
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control device provides cursor control on the PWP display device and communicates 
cursor movements to the controlling computer. Moreover, the PWP control module 
includes a buffer for storing cut and paste data such that a central buffer is used to store 
cut and paste data from each computer. This enables the present invention to allow 
5 cutting and pasting between the main window and the PWP window. The method of the 
present invention includes providing a PWP display device and computers connected to 
the device and selecting a default input device. The method further includes determining 
which display area the cursor in located and using the PWP control module to 
communicate cursor movements to the corresponding computer. Moreover, the present 

1 0 invention includes storing cut and paste data in a common PWP control module buffer. 
Other aspects and advantages of the present invention as well as a more 
complete understanding thereof will become apparent from the following detailed 
description, taken in conjunction with the accompanying drawings, illustrating by way of 
example the principles of the invention. Moreover, it is intended that the scope of the 

1 5 invention be limited by the claims and not by the preceding summary or the following 
detailed description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention can be further understood by reference to the following 
20 description and attached drawings that illustrate the preferred embodiments. Other 
features and advantages will be apparent from the following detailed description of the 
invention, taken in conjunction with the accompanying drawings, which illustrate, by way 
of example, the principles of the present invention. 

Referring now to the drawings in which like reference numbers represent 
25 corresponding parts throughout: 

FIG. 1 is a block diagram of a computer system incorporating the present 
invention and is shown for illustrative purposes only. 

FIG. 2 is a block diagram illustrating the components of the present invention. 

FIG. 3A is an exemplary example illustrating the control flow of the present 
30 invention when the cursor is in the main window. 

FIG. 3B is an exemplary example illustrating the control flow of the present 
invention when the cursor is on the border of the PWP window. 

FIG. 4 is a general flow diagram illustrating the operation of the PWP control 
module shown in FIG. 2. 
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DETAILED DESCRIPTION OF THE INVENTION 

In the following description of the invention, reference is made to the 
accompanying drawings, which form a part thereof, and in which is shown by way of 
5 illustration a specific example whereby the invention may be practiced. It is to be 
understood that other embodiments may be utilized and structural changes may be 
made without departing from the scope of the present invention. 

I. Introduction 

1 0 Current picture within a picture (PWP) display devices allow the connection of 

two or more computers and display information (such as data, text, video and images) 
from these computer in separate windows on the PWP display device. One way to 
control the information in each window is using a cursor on the PWP display device that 
can be moved within each window to manipulate and control information within the 

1 5 respective window. However, input devices from each computer can only be used to 
control each computer's respective window. In other words, which computer is 
controlling the cursor depends on which window the cursor is located. For example, if 
the cursor is located in the main window displaying data from a first computer the user 
controls the cursor using input devices from the first computer. Similarly, if the cursor is 

20 located in the PWP window displaying data from a second computer the user controls 
the cursor using input devices from the second computer. In order to change between 
input devices for the first and the second computers, the user must manually move 
between the two computers and associated input devices. 

The present invention provides an apparatus and method for allowing the input 

25 devices of one of the computers connected to the PWP display device to control 
information displayed in both windows. By way of example, even if the user is 
controlling the information using a cursor with an input device connected to the first 
computer and the cursor is moved to the border of the PWP window, the user can use 
the first computer's input devices to control and manipulate information within the PWP 

30 window without moving to another computer. Moreover, the present invention allows 
data and images to be cut and paste between the main window and the PWP window of 
the PWP display device. 

II. Exemplary Operating Environment 
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The following discussion is designed to provide a brief, general description of a 
suitable environment in which the present invention may be implemented. It should be 
noted that FIG. 1 depicts only one of several ways in which the present invention may be 
implemented. 



invention and is shown for illustrative purposes only. In particular, a computer system 
100 includes any suitable central processing unit (CPU) 110, such as a standard 
microprocessor, and any number of other objects interconnected by a computer bus 
112. It should be noted that the computer system 100 may also include a plurality of 

1 0 CPUs 110, such as may be used in a mainframe computer. For purposes of illustration, 
the computer system 100 includes memory such as random-access memory (RAM) 114, 
read-only memory (ROM) 116, and storage devices (such as hard disk or disk drives 
120) connected to the computer bus 1 12 by an input/output (I/O) adapter 118. The 
computer system 100 further includes a display adapter 122 for connecting the computer 

15 bus 1 12 to a suitable display device 128. A communications adapter 134 connects the 
computer bus 112 with a network 135. The communications adapter 134 includes a 
picture within a picture control module 1 36, which includes communications program for 
controlling a picture within a picture (PWP) display device in accordance with the present 
invention. 

20 A user interface adapter 138 is capable of connecting the computer bus 1 12 to 

other user interface devices, such as a keyboard 140, a speaker 146, a mouse 150 and 
a touchpad (not shown). In a preferred embodiment, a graphical user interface (GUI) 
and an operating system (OS) reside within a computer-readable media and contain 
device drivers that allow one or more users to manipulate object icons and text on the 

25 display device 128. Any suitable computer-readable media may retain the GUI and OS, 
such as, for example, the RAM 114, ROM 116, hard disk or disk drives 120 (such as 
magnetic diskette, magnetic tape, CD-ROM, optical disk or other suitable storage 



30 III. Components and Operation of the Invention 

The apparatus of the present invention allows control of a picture within a picture 
(PWP) display device by providing a PWP control module on each computer connected 
to the PWP display device. FIG. 2 is a block diagram illustrating the components of the 
present invention. In general, the present invention includes a first computer (computer 
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A 200) and a second computer (computer B 205), which are in communication over a 
network 210. Computer A 200 includes input devices such as keyboard A 215 and 
mouse A 220. Keyboard A 215 is in communication with a keyboard device driver 225 
and mouse A 220 is in communication with a mouse device driver 230. A network 
5 interface 235 and a network device driver 240 allow communication between computer A 
200 and the network 210. Similarly, computer B 205 includes input devices such as 
keyboard B 245 and mouse B 250 and a keyboard device driver 255 and a mouse 
device driver 260. These respective input devices for each computer provide interaction 
between a user and data on a display device. Moreover, mouse A 220 and mouse B 
1 0 250 provide additional functions such a drag and drop capabilities used in cut and paste 
operations. These additional functions and operations are well known to those having 
ordinary skill in the art. Computer B 205 also includes a network interface 265 and a 
network device driver 270 for allowing communication between computer B 205 and the 
network 210. 

15 A picture within a picture (PWP) display device 275 includes an input A (for 

connecting computer A 200 to the PWP display device 275) and an input B (for 
connecting computer B 205 to the PWP display device 275). The PWP display device 
includes a main window 280 (to which computer A 200 is connected) and a PWP 
window 283 (to which computer B 205 is connected). This gives the PWP display device 

20 275 the capability to display data and images from computer A 200 in the main window 
280 and to display data and images from computer B 205 in the PWP window 285. A 
cursor 288 is located on the PWP display device 275 and can be controlled by mouse A 
220 or mouse B 250. In a preferred embodiment, mouse A 220 is all that is needed to 
control the cursor 288 in both the main window 280 and the PWP window 285. It should 

25 be noted that the picture within a picture concept can be implemented in several other 
ways, and FIG. 2 is merely an exemplary representation of the PWP concept. 

Computer A 200 and computer B 205 also include a PWP control module on 
computer A 290 and a PWP control module on computer B 292 for allowing control of 
the PWP display device 275. The operation of the PWP control modules 290, 292 is 

30 explained in detail below. Both computer A 200 and computer B 205 also include a 

window manager 295 that notifies the PWP control modules 290, 292 on each computer 
the location of the cursor 288. 

FIG. 3A is an exemplary example illustrating the control flow (as depicted by the 
dashed arrows) of the present invention when the cursor 288 is in the main window 280. 
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In this example, the cursor 288 is controlled by mouse A 220. When a user moves 
mouse A 220, a signal to move the cursor (or a movement signal) is generated. The path 
of the movement signal from mouse A 220 to the cursor 288 located in the main window 
280 is shown in FIG. 3A by the arrows. Specifically, the movement signal is sent from 
5 mouse A 220 through the mouse device driver 230 to the PWP control module on 

computer A 290. The PWP control module 290 knows to send the movement signal to 
input A because the window manager 295 on computer A 200 informs the PWP control 
module 290 that the cursor 288 is within the main window 280. 

FIG. 3B is an exemplary example illustrating the control flow (as depicted by the 

1 0 dashed arrows) of the present invention when the cursor 288 is on the border of the 
PWP window 285. In this example, the present invention allows the cursor 288 to 
continue to be controlled by mouse A 220. When the user moves mouse A 220, a 
movement signal is generated. The path of the movement signal from mouse A 220 to 
the cursor 288 located at the border of or in the PWP window 285 is shown in FIG. 3B by 

1 5 the arrows. In particular, the movement signal passes from mouse A 220 through the 
mouse device driver 230 and to the PWP control module on computer A 290. At this 
point, the PWP control module 290 has been notified by the window manager 295 on 
computer A 200 that the cursor 288 is on the border the PWP window 285. Upon 
receiving this information, the PWP control module on computer A 290 redirects the 

20 movement signal received from mouse A 220 to the network device driver 240 and the 
network interface 235 where the movement signal is sent over the network 210 to 
computer B 205. The movement signal is received by the network interface 265 and 
network device driver 270 on computer B 205 and sent to the PWP control module on 
computer B 292. The PWP control module 292 recognizes that the movement signal 

25 needs to be sent to the PWP window 285 because the window manager 295 informed 
the PWP control module on computer B 292. The PWP control module 292 sends the 
movement signal from mouse A 220 through input B to the PWP window 285 where the 
cursor 288 is moved in response to the movement signal from mouse A 220. 

FIG. 4 is a general flow diagram illustrating the operation of the PWP control 

30 module shown in FIG. 2. Referring to FIGS. 3A, 3B and 4, the operation of the PWP 
control module will now be explained. This explanation assumes that mouse A is the 
input device used to control the cursor. The PWP control module on computer A 290 
and the PWP control module on computer B 292 are in communication over the network 
210. Referring to the PWP control module on computer A 290, a movement signal is 



7 




it No. AUS9-2000-0598-US1 



received from mouse A (box 400). Based on information from the window manager, it is 
determined whether the cursor is in the main window or on the border of the PWP 
window (box 410). If the cursor is in the main window, the PWP control module 290 
passes the movement signal received from mouse A to input A (box 420). In addition, if 
5 a cut and paste operation is being performed between windows, the cut and paste data 
is stored in a PWP control module common buffer 435. If the cursor is on the border of 
the PWP window, the movement signal from mouse A is sent over the network 210 to 
computer B (box 440). 

Referring now to the PWP control module on computer B 292, the movement 

1 0 signal from mouse A is received over the network from computer A (box 450). The 

window manager determines whether the cursor is in the main window or on the border 
of the PWP window (box 460). If the cursor is in the main window, the PWP control 
module on computer B 292 does nothing because computer A has control of the cursor 
and all movement signals are sent to input A (box 470). If the cursor is on the border of 

1 5 the PWP window, the PWP control module on computer B 292 passes the movement 
signal to input B (box 480). In this manner, mouse A can be used to control the cursor 
within both the main window and the PWP window. If a cut and paste operation is being 
performed between windows, the cut and paste data is stored in the PWP control 
module common buffer 435. 

20 The PWP control module common buffer 435 is a common mouse buffer storage 

area for consolidated buffering of cut and paste data. This enables data and images 
from the PWP window to be cut and pasted into the main window and vice versa. This is 
achieved using the PWP control module common buffer 435 to store cut and paste data 
instead of using the separate buffers for mouse A and mouse B. 

25 The foregoing description of the preferred embodiment of the invention has been 

presented for the purposes of illustration and description. It is not intended to be 
exhaustive or to limit the invention to the precise form disclosed. Many modifications 
and variations are possible in light of the above teaching. It is intended that the scope of 
the invention be limited not by this detailed description of the invention, but rather by the 

30 claims appended hereto. 
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